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This application is a continuation-in-part of 
copending U.S. Patent Application Ser. No. 09/987,336, 
filed November 14, 2001, which is a continuation-in-part of 
copending U.S. Patent Application Ser. No. 09/969,583, 
filed October 4, 2001. Copending U.S. Patent Applications 
Ser. Nos. 09/987,336 and 09/969,583 are hereby incorporated 
by reference. 



BACKGROUND OF THE INVENTION 



1 . Field of the Invention 

This invention relates to a system and method for 
capturing images and related data in a format that 
facilitates interpretation of the images and data by a 
human viewer or processing by a computer or other 
electronic processing device. 



U.S. Patent Application Ser. Nos . 09/987, 336 and 
09/969,583 disclose a system and method of stereoscopic 
data acquisition involving projection of one or more 
optical grids or other patterns onto a subject, the 
5 projected grid(s) or pattern (s) reflecting contours of the 
subject, and separation of the reflected grids or patterns 
for viewing or processing through the use of beam 
splitters. The present invention adds the possibility of 
using the system and method disclosed in the above-cited 
10 copending applications to collect stereoscopic data by 
illuminating the subject without projecting any sort of 
pattern onto the subject, and by utilizing background 
illumination and/or light, such as thermally induced 
infrared light, emitted by the subject itself. 

15 This extension of the basic principles described in 

the copending applications will be useful in any situation 
in which the subject either (i) radiates a unique pattern 
at specific frequencies of light and therefore can be 
detected and the subject identified by separation of the 

2 0 frequencies radiated by the subject from background 
frequencies of light, or (ii) reflects projected light to 
form an identifiable pattern or signature that can be 
detected upon separation of the projected light frequencies 
from the background. In either case, three-dimensional or 

25 stereoscopic data acquisition can be carried out either by 
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using spaced receivers to capture the identifiable pattern 
or signature from two or more different angles, or by 
illuminating the subject from multiple angles. For 
example, aircraft and incoming missiles have identifiable 
5 infrared light signatures that can be detected using 
infrared and visible light detectors, and matched filtering 
techniques. As in the copending applications, the 
contribution of the present invention is to use multiple 
detectors to detect the infrared light signatures from 

10 multiple angles, and to use optical processing to optically 
separate the signatures from background in order to 
facilitate subsequent processing. Reference grids, marks, 
or patterns may be included in the detectors, depending on 
the application, but such grids are not essential to this 

15 aspect of the invention. 

Key features of the invention include: 

• a subject that emits or reflects a specific radiation 
pattern or signature at known frequencies (the phrase 
"a subject" referring to one or more subjects, without 

2 0 any other limitation as to the nature of the subject) ; 

• one or more frequency discriminators, each including 
one or more beam splitters, that optically separate 
out the received image of the emitted or reflected 
pattern or signature; and 
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• for reflected radiation patterns or signatures, one or 
more radiation sources that emit radiation at 
frequencies corresponding to the patterns or 
signatures sought to be detected, either 
5 simultaneously or serially. 

These key features of the invention may be used in 
connection with any of the applications disclosed in the 
copending applications, and in additional applications 
involving the use of fiber optics to direct images at 
lA 10 appropriate receivers, thermography, or the use of 
}*l frequency discrimination in combination with pass-through 

?y of the image (such as a night vision goggle that passes the 

hi combined image through to one eye, and a frequency 

: - ^ — , 

, discriminated image through to the other eye, and/or that 

{:£ 15 is capable of switching between day and night vision) . 
in Also, the additional applications, including the use of 

f|j fiber optics and combination with pass-through receivers 

may be used in connection with the grid projection 
arrangement disclosed in the copending applications. 



2 0 2 . Description of Related Art 

The ability to rapidly capture or render images of a 
subject in a manner which enables movements of the subject 
to be tracked in three-dimensions, and/or to draw the 
subject as it moves, has been a goal of computer 

25 programmers for many years. One of the initial 
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applications for such three-dimensional image capture and 
processing was to detect defects in the surfaces of 
manufactured items. More recently, proposals have been 
made to use three-dimensional image input systems and 
5 methods to control computers based on hand or eye 
movements, to insert images of persons into video games, to 
track movements of the subject to analyze the movements or 
so that the subject can interact with the video game or 
other virtual reality program, identify fingerprints or 
10 recognize persons based on their profiles, and/or for use 
in domestic security, air traffic control, or defense- 
related tracking, targeting, intelligence gathering, and 
guidance systems . 



Ci All of these applications require substantial 

fQ 15 processor resources, and even the simplest such systems 
ry tend to stretch the limits of currently available computer 

systems. The technology for utilizing three-dimensional 
data input is developing rapidly, but commercialization of 
the technology has been limited by either (i) the cost and 
2 0 complexity of current data input hardware and control 
software, or (ii) if simpler input means are used, the cost 
and complexity of image processing software necessary to 
make sense of the data. The present invention seeks to 
simplify both image capture hardware and the image 
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processing software necessary to enable a projected grid to 
be captured, displayed, and/or analyzed. 

To accomplish this, the present invention enables 
input either of a reference grid that captures the contours 
of the subject, a pattern or signature emitted by the 
subject, or a reflected pattern or signature having 
specific frequencies that can be separated from a composite 
image of the subject, by using simple optical means such as 
beam splitters to capture an electronic image of the grid 
that can be processed without the need to electronically 
separate it from its background. The contours, patterns, 
or signature represented by the optically separated grid 
can then be displayed without further electronic 
processing, or analyzed using relatively simple numerical 
analysis rather than more difficult qualitative analysis. 
While systems and methods that utilize grid projection and 
frequency discrimination are known, most rely on electronic 
processing techniques, and none simplifies processing as 
much as the present invention. 

The following references illustrate general principles 
of three-dimensional imaging, measurement or mapping of 
three-dimensional surfaces using scanners, tracking of 
moving objects in three-dimensions, and/or stereoscopic 
image processing and analysis, but fail to show either the 



grid projection or image separation aspects of the present 
invention: 

With respect to the grid projection aspect of the 
invention, U.S. Patent No. 6,252,623 discloses imposing a 
5 three-color grid pattern on a subject, but the grid is 
created by projecting visible light through a color 
grating, which makes it difficult to distinguish the grid 
in the presence of background visible light, and separating 
the colors of the one -dimensional grid electronically 
10 rather than optically based on pixels activated by the CCD. 

U.S. Patent No. 6,205,243 discloses a system that 
projects laser scan lines onto a subject with sufficient 
rapidity to form a u mesh" in the composite image that can 
be used to determine surface contours. However, the use of 
15 laser scanning in the system of this patent makes the 
system much more complicated than is the case with a system 
that uses multiple light frequencies to distinguish an 
image of a subject from one or more reference grids 
projected onto the subject. 

20 U.S. Patent No. 5,982,352 discloses use of grid 

distortion to indicate the location and force of contact 
between a user and a surface, such as a touch screen 
surface or the floor. In several examples, the grid is 
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projected onto the surface and captured by a "tv camera" 
connected to a computer, but there is no provision for use 
of multiple light frequencies to distinguish an image of 
the subject from the reference grid, or for optical 
separation so the grid from a composite image of the 
subject and grid. 

Finally, with respect to the grid projection aspect of 
the invention, U.S. Patent No. 6,191,850 discloses 
projection of a grid pattern onto an object of manufacture 
for the purpose of detecting surface defects, but there is 
again no provision for use of multiple light frequencies to 
distinguish an image of the subject from the reference 
grid, or for optical separation so the grid from a 
composite image of the subject and grid. 

With respect to the optical separation or beam 
splitter aspect of the invention, U.S. Patent No. 5,910,816 
discloses the use of dichroic beam splitters to separate 
visible and infrared components of an image, but there is 
no way to separate infrared components from each other, and 
the infrared components do not represent a grid or other 
pattern projected onto the subject. 

By way of background, numerous references disclose 
generation of a three-dimensional representation of a 
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subject by utilizing scanning and/or complex image 
processing that does not rely on reference grids. For 
example, Fig. 3 of U.S. Patent No. 5,531,520 shows 
"striping" created by processing data generated by a laser 
scanner. The striping is overlaid over an image of a or 
tumor for the purpose of assisting a surgeon in locating 
the tumor. 

Similar laser scanning systems, for analyzing objects 
in a manufacturing setting, are disclosed in U.S. Patent 
Nos. 4,628,469 and 4,498,778. 

U.S. Patent No. 5,129,010 discloses use of "infrared 
laser slit light" for the purpose of determining the 
flushness of an automobile assembly, but the "slit light" 
is scanned and does not form a grid, while U.S. Patent Nos. 
5,280,542 and 4,600,012 disclose similar systems utilizing 
non-infrared pulsed slit lines. 

U.S. Patent No. 4,914,460 discloses projection of a 
laser grid in the form of linear series of discrete spots 
onto an object, but only for the purpose of determining 
position and orientation of a submarine object. 

U.S. Patent Nos. 6,009,210 and 6,215,471 disclose a 
purely electronic computer input device which tracks a face 
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by comparing an image of the face with reference images 
representing different positions, while U.S. Patent No. 
6,215,471 tracks a face by tracking movement of "landmarks" 
on the face, and U.S. Patent No. 5,767,842 discloses a 
5 similar system for fingers. 

The concept of using three-dimensional object sensing 
as a computer input means is also disclosed in U.S. Patent 
No. 5,900,863, but the object sensing is either based on 
parallax range finding, or on determining object parameters 
10 by determining which of an array of light beams is 
reflected (or blocked) by the object. A more sophisticated 
and complex version of a computer input that employs object 
detection by pixel -analysis input device is disclosed in 
U.S. Patent No. 6,144,366. 

15 U.S. Patent Nos . 6,002,808 and 6,222,465 disclose a 

respective "hand gesture control" and "video gesture 
recognition" system in which images of a hand are 
electronically analyzed to detect movement. 

U.S. Patent No. 5,235,416 discloses use of two cameras 
2 0 sensitive to different wavelengths, and two corresponding 
illumination sources to simultaneously image two sides of 
an object without interference, but does not disclose use 



10 



of beam splitters to discriminate the image, or use of the 
cameras for stereoscopic imaging. 

U.S. Patent No. 5,528,263 discloses a system in which 
a grid is projected onto a two-dimensional projection 
5 screen to enable location of a pointer, rather than being 
projected onto a three-dimensional surface to indicate 
contours of the surface. 

Finally, U.S. Patent No. 4,499,492 is representative 
of a number of patents disclosing "range imaging employing 
10 parallax" which utilizes scanning to determine the distance 
to a selected point on an object. U.S. Patent No. 
6,198,485 discloses using such a range finding system to 
track a marker placed on a finger. 

Similar "ladar" systems that use laser radar to 
15 acquire data on three-dimensional subjects for mapping, 
target acquisition, and similar applications, both civilian 
and military, are also disclosed in a paper entitled "Ladar 
systems for 3D measuring applications," available on the 
Internet at "laseroptronic.com." This paper describes a 
2 0 number of applications for 3D laser radar scanner units 
capable of measuring and storing up to 50,000 3D 
points/sec, but with no suggestion that projected optical 
grids and/or optical image processing can be used in 
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connection with the radar scanner units to greatly increase 
data acquisition speeds or efficiency. 

SUMMARY OF THE INVENTION 

It is accordingly a first objective of the invention 
5 to provide a simple and inexpensive system and method for 
capturing stereoscopic images and related data in a format 
that facilitates interpretation of the images and data by 
a human viewer or processing by a computer or other 
electronic processing device 

10 It is a second objective of the invention to provide 

a system and method for capturing stereoscopic images and 
related data in a format that facilitates processing by a 
computer or other electronic processing device in a way 
that eliminates the need for feature extraction, 

15 interpolation, and other complex image processing software 
or algorithms. 

It is a third objective of the invention to provide a 
system and method for capturing stereoscopic images and 
related data in a format that facilitates interpretation of 
2 0 the images and data by a human viewer or processing by a 
computer or other electronic processing device, and which 
does not require complex scanning hardware or software but 
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rather may use ordinary fixed cameras or other viewing or 
image capture devices, and conventional light sources. 

It is a fourth objective of the invention to provide 
a system and method for capturing contours of a three- 
dimensional subject that permits the contours to be 
captured and displayed without any further electronic 
processing . 

It is a fifth objective of the invention to provide a 
system and method for capturing contours of a three- 
dimensional subject that enables correlation of superposed 
grid lines and a visible light image of the subject, while 
permitting direct analysis of the grid lines without the 
need for electronically separating the grid lines from the 
visible light image of the subject. 

It is a sixth objective of the invention to provide a 
system and method for acquiring data concerning three- 
dimensional objects that provides range-related data as 
well as profile data. 

It is a seventh objective of the invention to provide 
a system and method for acquiring data concerning three- 
dimensional objects that enables sampling or gating of as 
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few as one pixel in a scanned image without loss of 
resolution. 

It is a eighth objective of the invention to provide 
a ladar mapping, tracking, guidance, or target acquisition 
system having increased speed and accuracy without 
substantially increased complexity. 

It is an ninth objective of the invention to provide 
a three-dimensional imaging system useful for guidance, 
tracking, target acquisition, and other similar 
applications, and that has reduced vulnerability to bloom, 
blinding, and deflection techniques. 

It is a tenth objective of the invention to provide a 
three-dimensional imaging system that can track specific 
temperatures and shapes in a wide variety of environments, 
including at night and underwater, and that can relatively 
easily be configured to accomplish detailed analysis of 
subjects on scales ranging from microscopic to planetary. 

These objectives are accomplished, in accordance with 
the principles of a preferred embodiment of the invention, 
by providing a system and method for capturing contours of 
a three-dimensional subject, and/or acquiring data 
correlated with three-dimensional geometric features or 
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location of the subject, in which a two-dimensional grid is 
projected onto the three-dimensional subject, and/or in 
which a pattern or signature emitted or reflected by the 
subject is captured under natural illumination or 
patternless projected illumination, and in which the grid, 
pattern, or signature is optically separated from a 
composite image of the subject using one or more receivers, 
each including one or more beam splitters, for viewing or 
further processing . 

The objectives of the invention are also accomplished 
by providing a system and method for capturing contours of 
a three-dimensional subject or related data, which uses 
optical separation of a grid, pattern, or radiation 
signature from the composite image so as to simplify 
electronic processing, and which in the case where multiple 
grids are used to achieve a stereoscopic effect without the 
need for multiple cameras situated at different angles, 
uses optical separation of the multiple grids from each 
other so as to further simplify subsequent electronic 
processing. 

The objectives of the invention are further 
accomplished by providing a system and method for capturing 
contours of a three-dimensional subject, or related data, 
which uses a beam splitter to extract the grids from the 
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visible light portion of the composite image of the 
subject, and a beam splitter to distinguish the grids from 
each other. Alternatively, separate images of the grids 
may be obtained through the use of discrete image capture 
devices or media sensitive to wavelengths or frequencies 
corresponding to those of one grid but not the other grid. 

Those skilled in the art will appreciate that the 
three-dimensional data that may be acquired by the method 
and apparatus of the invention includes, but is not limited 
to, data related to geometry, distance, texture, velocity, 
temperature, and scale. In addition, those skilled in the 
art will appreciate that any of the above-described aspects 
or embodiments of the invention may be used in connection 
with any of the applications of three-dimensional imaging 
noted above, including generation of a three-dimensional 
representation of a subject, detection or analysis of 
subject movements, detection of flaws in the subject, 
subject identification or recognition, and targeting or 
range finding. 

To this end, the invention is not to be limited to 
capture of the grids, patterns, or signatures by a 
particular camera or detector arrangement or type, to 
particular numbers, arrangements, or types of projection 
equipment, or to grids having a particular frequency or 
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range of frequencies. Either the projectors (if utilized) 
or the detectors may be fixed or movable, each grid, 
pattern, or signature may be captured by one or more 
detectors, and each detector may be arranged to capture one 
or more grids, patterns, or signatures. Furthermore, where 
projected grids are used, the "grids" may be in the form of 
patterns other than grids made up of mutually perpendicular 
sets of lines, or may be collapsed into one -dimensional 
lines captured by separate detectors and combined following 
detection, and the grids may be projected in combination 
with other types of indicia such as hash marks used for 
targeting or range finding. 

Range finding may be achieved either by aligning 
images of multiple grids, patterns, or signatures, whether 
the result of grid projection, emission by the subject, or 
patternless illumination, in the manner of a conventional 
photographic camera viewfinder, or by isolating a point on 
a projected grid or discriminated pattern or signature and 
scanning the subject with a ladar radar (ladar) device. 



BRIEF DESCRIPTION OF THE DRAWINGS 



Fig. 1 is a side view of a subject illuminated by an 
infrared grid projection system constructed in accordance 



with the principles described in copending U.S. Patent 
Application Ser. Nos . 09/987,336 and 09/969,583. 

Fig. 2 is a side view illustrating the use of multiple 
projection systems to complete a 360° view of the subject. 

Fig. 3 is a front view of the subject illustrated in 
Fig. 1. 

Fig. 4 is a perspective view showing grid distortion 
along contours of the subject illustrated in Fig. 1. 

Fig. 5 illustrates a captured image taken in the 
presence of visible light and containing two infrared grids 
projected from different angles, together with the results 
of wavelength separation of the composite image into 
separate images of the two infrared grids and a visible 
image of the subject. 

Figs. 6 and 7 illustrate filtering apparatus utilized 
by the present invention. 

Fig. 8 is a schematic illustration showing use of the 
invention for range finding. 
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Fig. 9 is a schematic illustration showing a complete 
imaging system utilizing a stereoscopic arrangement 
corresponding to the arrangement shown in Fig. 5. 

Figs. 10-13 are schematic diagrams of various airplane 
and airport security applications corresponding to those 
described in copending U.S. Patent Application Ser. Nos. 
09/987,336 and 09/969,583. 

Fig. 14 is a schematic diagram of a tracking or 
targeting system that utilizes the principles of the 
invention. 

Figs. 15 and 16 is are schematic diagrams of tracking 
systems corresponding to that of Fig. 14, but in which the 
projected grids are replaced by reflections resulting from 
patternless illumination, or by radiation signatures of the 
subj ect . 

Figs. 17A-17C are schematic diagrams illustrating use 
of fiber optics in connection with the preferred 
embodiments of the invention. 

Figs. 18A-18E are schematic diagrams illustrating 
variations of the receiver illustrated in Figs. 6 and 7. 



DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

The present invention extends the principles described 
in the copending applications to encompass patterns 
resulting from illumination of a subject using patternless 
illumination, radiation signatures emitted by the subject 
itself, and combinations of projected grids, patternless 
illumination, and radiation signatures. Initially, the 
invention will be described in connection with the 
projected grids illustrated in Figs. 1-14, but it should be 
kept in mind that any of the specific arrangements 
illustrated in Figs. 1-14 may be modified such that one or 
more of the sources projects patternless light rather than 
a grid, and that the illumination sources may be entirely 
omitted where detectable and identifiable radiation 
signatures are emitted by the subject even without external 
illumination. Specific examples of systems that do not 
utilize projected grids, in accordance with the principles 
of the present invention, are illustrated in Figs. 15, 16, 
and 18. Fig. 17 illustrates the use of fiber optics to 
guide an image to a receiver in any of the illustrated 
embodiments 

Fig. 1 illustrates an embodiment of the invention in 
which the subject 1 is illuminated by a single infrared 
grid 2 projected from the front of the subject by a 



20 



projector 3, as described in copending U.S. Patent 
Application Ser. Nos . 09/987,336 and 09/969,583. Although 
illustrated as involving a projected grid or grids, the 
subject 1 may also be illuminated by a substantially 
5 uniform light source 4, by multiple light sources, or by 
ambient light. 

In a variation of the embodiment of Fig. 1, multiple 
grids 2 and 2 1 may be projected onto the subject in order 
to enable capture of contours for the entire 360° of the 
10 subject by using an additional camera 5 (or, equivalent ly, 
by moving projector 3 around the subject) , as illustrated 
in Fig. 2 . 

Each grid shown in Figs. 1 and 2 is preferably an 
infrared grid having a wavelength of sufficient intensity 

15 to enable an image of the grid to be captured despite 
background infrared radiation that might be emitted by the 
subject, and is made up of mutually perpendicular 
horizontal and vertical lines. Suitable infrared light 
sources are well-known, as are cameras and film capable of 

2 0 capturing infrared light. The projectors 3 and 5 may be 
simple lamp and mask arrangements in which the lamp is 
arranged to illuminate the subject through a mask having 
openings in the shape of a grid, or an arrangement in which 
the lamp is reflected by a grid-shaped reflector, although 
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the invention is not to be limited to such lamp and mask or 
reflector arrangements. 

Light source 4 may be a visible, infrared, or 
ultraviolet light source for enabling the camera to capture 

5 features of the subject other than the contours reflected 
in the captured grid. According to the principles of the 
invention, the exact wavelength or wavelengths of light 
source 4 may be freely varied to meet requirements of the 
application in which the invention is used, except that the 

10 wavelength or wavelengths emitted by the light source 4 
must be different than those emitted by projector 3. As 
explained below, use of different wavelengths to illuminate 
the subject as a whole than are used for the grid makes it 
possible to more easily separate the image of the grid from 

15 that of the subject. 

It may, in some circumstances, be useful simply to 
capture an image of the infrared grid without illumination 
of the entire subject, in which case lamp 4 may be omitted. 
On the other hand, a significant advantage of the invention 
20 is that it permits a visible, ultraviolet, or infrared 
light image of the subject to be captured with the grid 
superposed so that aspects of the subject such as coloring, 
and also details of physical features smaller than the 
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smallest grid unit, can be captured and located with 
reference to the grid. 

Although infrared light is preferred for many 
applications, the principles of the invention are not 
5 limited to infrared grids, or to grids having a specific 
frequency. In some applications, it may be desirable to 
use mult i -spectrum waves, enabling the penetration of 
current guidance defense techniques and/or to increase 
effectiveness over the widest variety of environmental 
10 conditions. The only requirements are that the light used 
to illuminate the subject, and the light projected to form 
each grid, be of different frequencies or ranges of 
frequencies so as to enable separation by beam splitters 
having appropriate bandwidths . 

15 As illustrated in Fig. 3, the use of a single grid 2, 

or corresponding single grids 2 and 3 projected onto the 
front and back of the subject, does not by itself permit 
contours of the subject to be determined. Instead, 
contours of the subject are only revealed by capturing the 

2 0 image at an angle relative to the side of the subject whose 
contours are to be captured or analyzed, as illustrated in 
Fig. 4. By using two cameras on each side of the 
projector, a stereoscopic view can be captured using a 
single grid. 
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In order to avoid the need to capture two images of 
the subject, however, it is also possible to create a 
stereoscopic effect by orienting the projectors at angles 
relative to the subject, and positioning the camera midway 
between the projectors, as illustrated in Fig. 5. Image 10 
in Fig. 5 is a front view of the subject onto which has 
been projected two infrared grids 11 and 12 using two 
projectors (not shown) of the type illustrated in Fig. 2, 
oriented at equal angles on each side of the camera or 
image capture apparatus. According to the principles of 
the invention, the composite image 10 consists of, and may 
be separated into, three constituent images: (i) an image 
13 of the first grid 11, (ii) an image 14 of the second 
grid 12, (iii) a image 15 of the subject without the grids. 
Although images 13 and 14 show the subject and background, 
the subject and background can be made to disappear by 
selecting appropriate grid wavelengths and bandwidths of 
the filters or beam splitters used to separate the images, 
leaving only images of the respective grids. Of course, by 
adding one or more cameras and projectors to the 
arrangement illustrated in Fig. 5, or by moving the cameras 
and projectors of Fig. 5 around the subject, it is possible 
to capture a 360° view of the subject. 

Separation of image 15 from images 13 and 14 is 
accomplished, as described above, by using different 
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wavelengths for image 15 and the grids in images 13 and 14. 
In addition, the left and right grids in images 13 and 14 
are preferably also projected using light sources of 
different frequency. 

5 Image processing techniques for generating a three- 

dimensional image of a subject based on contours are well- 
known and need not be described in detail herein. However, 
image processing is uniquely facilitated in the system and 
method of the present invention by including a filtering 

10 device 20 that optically, rather than electronically, 
separates the one or more infrared grids from the visible 
light image. This device may be used to separate light 
reflected directly from the subject, in lieu of a camera, 
or may be used to process a recorded image or slide, or an 

15 image of the subject displayed on a CRT, LCD, or the like. 

The filter device 20 includes a pair of beam splitters 
21 and 22, one of which is arranged to separate the 
infrared light of the grid from the light used to 
illuminate the subject, which may be visible light, and the 
20 other of which is arranged to separate infrared light of 
different frequencies. The first beam splitter transmits 
the image of the subject to a detector A while reflecting 
the infrared light images of the two grids. The second 
beam splitter separates the infrared light images of the 
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two grids into separate images of the respective grids by 
transmitting one frequency of infrared light to a detector 
B and the other frequency of infrared light to a detector 
C for separate, simplified processing. 

5 In the variation illustrated in Fig. 7, device 25 

includes beam splitters 2 6 and 2 7 arranged to separate 
light of different frequencies in the same manner as beam 
splitters 21 and 22, except that the image of the subject 
is reflected rather than transmitted to detector A, and the 
10 image of the first grid is reflected rather than 
transmitted to detector B. 

It will be appreciated by those skilled in the art 
that suitable beam splitters are well-known and readily 
available or manuf acturable . In addition, the beam 

15 splitters may be replaced by other filter arrangements, 
such as an arrangement in which the composite image is 
filtered by parallel filters for the three frequencies, 
rather than series arrangements illustrated in Figs. 6 and 
7, i.e., the composite image duplicated twice and directed 

20 to separate filters for transmission of the respective 
images. Alternatively, the filter arrangements may be 
replaced by image capture devices or media sensitive to the 
wavelength or frequency of one of the respective grids, but 
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not to the wavelength or frequency of the other grid or of 
the background illumination. 

Figs. 18A-18E show further variations of the receiver 
of Figs. 6 and 7. In the arrangement illustrated in Fig. 
5 18A, data is captured by digital image capture devices and 
supplied to a computer. The images X and Y are not 
necessarily projected grids, but rather may be the result 
of illumination by uniform or patternless light sources, 
scanning, or emissions originating from the subject itself. 
10 Otherwise, the operation of the receiver is similar to that 
illustrated in Fig. 7, with the image data being separated 
into distinct data groups optically (on- the- fly) , thereby 
enabling available computing resources to be more fully 
dedicated to analysis and conversion of data. 

15 In the receiver 92 illustrated in Fig. 18B, a third 

beam splitter 93 and image capture device are added to the 
receiver, to not only permit separation of projected grids 
or other reflected patterns from a composite image of the 
subject 90, but also to separate an image in the full 

2 0 infrared spectrum from the composite visible/ infrared 
image. The full infrared image provides a thermal profile 
of the subject and, in combination with geometric data and 
the composite image, can be used deduce or reverse engineer 
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internal components of the subject, which might, for 
example, be a missile or aircraft. 

In the receiver 92' illustrated in Fig. 18C, masks or 
filters 94 are positioned in front of the image capture 
5 device to provide a reference for, or to further 
facilitate, analysis of the extract images of the reflected 
patterns and full infrared image. Similarly, in the 
receiver 82" illustrated in Fig. 18D, the masks or filters 
are integrated into or otherwise associated with the beam 
10 splitters 95. 

Finally, the receiver of Fig. 18E is a digital camera 
corresponding to the receiver of Fig. 9, but with an 
additional beam splitter arranged to separate a full 
infrared image of the subject 90 from the composite image 
15 of the subject. 

In the embodiment illustrated in Fig. 8, two 
projectors 3 0 and 31 are aimed at a subject (not shown), 
with the objective of creating a set of stereoscopic 
profiles corresponding to those illustrated in Fig. 5. 
2 0 However, the arrangement of this embodiment has the added 
feature that the azimuth of the projectors may be adjusted 
by mechanisms 34 and 3 5 so that the grids can be positioned 
on subjects at various distances from the projector. In 
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that case, the azimuth angles a and (3 of the detectors when 
the grids overlap, i.e., upon alignment of corresponding 
hash marks, will give the relative angles and distance from 
the projectors to the subject. Those skilled in the art 
5 will appreciate that rather than adjusting the azimuth of 
at least one of the receivers, it is also possible to track 
an object by monitoring grids projected at a fixed angle, 
the distance to the subject being known when landmarks on 
the reflected grids coincide. 

10 In the embodiment illustrated in Fig. 9, the 

projectors and receiver are combined to form a digital 
imaging camera 4 0 having a lens 41 for focusing the image 
of the subject 42 and corresponding reflected grids 43,44 
projected by respective left and right projectors 45,46. 

15 The grids have hash marks to enable range finding as 
described above in connection with Fig. 8, and are 
reflected by mirror 47 to a pair of beam splitters 48,49 
that separate the grids and output an image 5 0 to a viewer 
or imaging device such as a CCD. 

20 Although the invention is suitable for applications 

too numerous to specify, one application for which there is 
an especially urgent need is airport security. In the 
arrangement illustrated in Fig. 10, projectors 55 and 56 
are hidden in the walls 57,58 of an airport corridor and a 
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receiver 59 corresponding to the one illustrated in Fig. 9 
is hidden above a doorway or entrance 6 0 in order to 
capture stereoscopic images or image data for analysis by 
pattern matching, curve fitting, or other well-known data 
processing techniques. Alternatively, as illustrated in 
Fig. 11, projectors 61,62 may be associated with separate 
receivers 63,64, each including a single beam splitter or 
other image capture device sensitive to the wavelength or 
frequency of a corresponding grid. 

In the arrangement illustrated in Fig. 12, projectors 
65 and receivers 66 corresponding to those illustrated in 
Fig. 10 are arranged in the front and rear bulkheads 67 of 
the cabin of a passenger airplane 68, while in the 
arrangement illustrated in Fig. 13, projectors 69 and 
receivers 70 corresponding to those illustrated in Fig. 11 
are positioned in the walls 71 of a walk-through metal 
detector . 

Fig. 14 shows a tracking or targeting system utilizing 
tower mounted grid projectors 72 and a central receiver 73 
corresponding to the arrangement of Figs. 10 and 12, while 
Fig. 15 shows a satellite mounted system corresponding to 
the arrangement shown in Figs. 11 and 13, with separate 
receivers 74 for each projector 75. The satellite-based 
system of Fig. 15 could be used as part of an anti- 



ballistic missile defense system, to track cloud 
formations, for mapping, or for a variety of other 
scientific and military purposes. 

Fig. 15 shows a tracking or targeting system in which 
5 grid projectors 72 of Fig. 14 are replaced by one or more 
patternless light sources 72' arranged to illuminate the 
subject with light 81 having specific frequencies, or with 
light that results in reflections 80 having specific 
frequencies, the reflections being capable of 
10 discrimination by one or more detectors 73 corresponding to 
the detector illustrated in Fig. 14. Those skilled in the 
art will appreciate that the positions of sources 72' and 
detectors 73 will depend on the specific application in 
which the detectors and sources are used, and that the 
15 illustrated arrangement is not to be taken as limiting. 
Furthermore, those skilled in the art will appreciate that 
any or all of the detector (s) 73 may further include a 
reference mask, pattern, or matched filter 84. 

Fig. 16 shows a further extension of the principles of 
20 the invention, in which external illumination sources 72' 
are omitted and a radiation signature of the subject is 
instead passively detected by at least two receivers 73. 
Fig. 16 also shows the feature whereby at least one of the 
receivers 73 is arranged to be moved by a controller 8 6 in 
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order to permit tracking or range finding according to the 
principles described above. 

Finally, Figs. 17A-17C illustrate the principle that 
one or more optical fibers 91 could be used to transmit 
images of the subject 90 to a receiver 92,96 and/or to 
project grids or other patterns from sources 96,97 onto the 
subject 90. In the embodiment of Fig. 17A, the grid or 
pattern is projected by conventional means, while in the 
embodiment of Fig. 17B, both projection and image capture 
are carried out through the same fibers and 
receiver/projector combinations 96 (for example by 
alternating projection and image capture) and in the 
embodiment of Fig. 17C, separate projectors 97 and receiver 
92 with corresponding fibers 91 are provided. Those skilled 
in the art will appreciate that arrangements of optical 
fibers could be used with any of the embodiments 
illustrated in Figs. 1-16, or in any of the embodiments 
illustrated in parent application Ser. Nos. 09/987,336 and 
09/969, 583 . 

Having thus described various preferred embodiments of 
the invention in sufficient detail to enable those skilled 
in the art to make and use the invention, it will 
nevertheless be appreciated that numerous variations and 
modifications of the illustrated embodiment may be made 



without departing from the spirit of the invention. For 
example, the receivers of the invention may be used in 
connection with a night vision helmet, with one side 
providing an infrared image of the subject and the other 
providing a composite image. It is therefore intended that 
the invention not be limited by the above description or 
accompanying drawings, but that it be defined solely in 
accordance with the appended claims. 



